Supersolid versus Phase Separation in Atomic Bose-Fermi Mixtures 
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We show that a two-dimensional atomic mixture of Bosons and Fermions cooled into their quantum 
degenerate states and subject to an optical lattice develops a supersolid phase characterized by 
the simultaneous presence of a non-trivial crystalline order and phase order. This transition is in 
competition with a phase separated ground state. We determine the phase diagram of the system 
and propose an experiment allowing for the observation of the supersolid phase. 



Cooling atoms to the nK regime allows for the realiza- 
tion and study of new thermodynamic phase transitions 
and their associated phases, with an interesting synergy 
emerging between the fields of quantum atom optics and 
condensed matter physics. Recent trends are the study of 
the superfluid to Mott-insulator phase transition appear- 
ingin cold bosonic systems subject to an optical lattice 
[l|, y and the striving for the realization of a BCS-type 



condensate in a fermionic system [3; 14- In this letter, we 
investigate the possibility to realize a non-trivial super- 
solid phase in a mixed boson-fermion system sympatheti- 
cally cooled into their corresponding quantum degenerate 
states 0, 0| . We identify a promising system where this 
novel phase can be observed and determine the relevant 
phase diagram. 

Supersolids simultaneously exhibit two types of order 
which usually appear in competition to each other — 
these are the diagonal long-range order (DLRO) associ- 
ated with the periodic density modulation in a crystal 
and the off-diagonal long-range order (ODLRO) associ- 
ated with the phase order in the condensate Super- 
solids have been proposed to exist in the strongly inter- 
acting ^He system la IQ I , where experimental results are 
still hotly debated [liJ, [llj , and in various model systems 
describing interacting Bosons on a lattice and analyzed 
numerically 12, 13, 14] . Here, we investigate the possi- 
bility to use a specifically tuned boson-fermion mixture 
to realize a supersolid phase in a controlled experiment. 

The basic idea underlying our scheme is to share tasks 
between the fermions and the bosons: the fermions are 
tuned through a density wave instability establishing 
crystalline order (DLRO), while the condensate bosons 
provide the off-diagonal long range order (ODLRO). The 
interaction with the fermions imprints an additional den- 
sity modulation also in the bosonic density field, hence 
resulting in a supersolid phase. In order to trigger a den- 
sity wave instability in the fermions, we confine the mixed 
boson-fermion system to two dimensions and subject it 
to an optical latti ce p roviding perfect Fermi surface nest- 
ing at half-filling [l5j. Note, that the resulting crystalline 
order relevant for the DLRO component in the supersolid 
is not due to the density modulation enforced by the op- 
tical lattice but is the superstructure triggered by the 
density wave instability. 
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FIG. 1: Left: Sketch of the ApB-l/iB-r phase diagram. For 
Tdw > Tps the low temperature phase at T < 

Tuw is a super- 
solid (SS), while phase separation (PS) emerges at T < Tps 
for Tps > Tdw- Right: bosonic density ns{x,y) for the su- 
perfluid (SF), phase separated, and supersolid phases. 



The supersolid transition triggered by the fermions 
competes with an instability towards phase separation 
in the boson system [lil IT^ . Given the dimensional- 
ity and the lattice geometry of our system, the presence 
of van Hove singularities strongly enhances the tendency 
towards phase separation and produces new and interest- 
ing features in this transition: an arbitrary weak inter- 
action between the bosons and the fermions is sufficient 
to drive the phase separation at low temperatures. How- 
ever, proper tuning of the parameters allows to supersede 
this phase separation through the supersolid transition 
shown in Fig. ^ In the following, we first investigate the 
two instabilities towards phase separation and density 
wave formation and then analyze the supersolid phase 
within a mean-field scheme. We focus on the weak cou- 
pling limit between the bosons and the fermions, which 
excludes a demixing in a repulsive fermion-boson system 
along the lines discussed in Ref. [l8j |. 

The Hamiltonian for interacting bosons and fermions 
subject to an optical lattice takes the form H = + 
H^ + H,„, with (q! = F,B) 



dx tp^ 



2m. 



-A + K(x) V, 
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2 



Here, we assume a repulsive interaction = ^irasfi^ /m 
between the bosons, with the scattering length as > 0. 
The coupling t^pB — 2TTap^h'^ / ii accounts for the interac- 
tion between the fermions and the bosons, with fi the rel- 
ative mass and Ope the boson-fermion scattering length. 
Furthermore, we restrict the analysis to spinless fermions; 
such a spinless fermionic atom gas is naturally achieved 
via spin polarization. The s-wave scattering length in 
the fermion system vanishes, while p-wave scattering is 
small in general and is neglected in the following analy- 
sis. The optical lattice with wave length A provides an 
a = A/2-periodic potential for the bosons and fermions 
with Vp_b(x) = Vp_B[sin^(7ra;/a) -I- sin^ (-Try/a)]. We ex- 
pand the bosonic and fermionic field operators t/'b.f in the 
Bloch wave functions Vk,n and Wk,n of the single particle 
problem in a periodic potential, (we restrict the analysis 
to the lowest Bloch band) 

■(/'b(x) =^ 6kWk(x), iPe{x) =^ CkWk(x). (2) 



ke_ff 



keA' 



Here, K denotes the first Brillouin zone, while 6k and 
Ck are the bosonic and fermionic annihilation operators. 
For a strong optical lattice b > -Ep g = 2?i^7r^/A^mF.B, 
the restriction to the lowest Bloch band is justified, and 
the Hamiltonian simplifies to |l[ 



keA' 



{k.k',q,q'} 



Eep(q)c+Cq + ^ J2 ^i^&k'CqV' (3) 



qeA' 



N 



{k,k',q,q'} 



with quantization volume V = No? and N the number 
of unit cells (below, rip b denote the number of parti- 
cles per unit cell). The summation {k, k',q, q'} is re- 
stricted to k, k',q, q' G K with the momentum con- 
servation k — k' + q — q' = K.,„; the reciprocal lat- 
tice vector Km accounts for Umklapp processes. Here, 
f^FB = Sfb/ (ix|u)p|7Jp and = 9b J dxlw]'^, with w{x) 
and ?J(x) the Wannier functions associated with the Bloch 
band and Wk while Cp B(k) denote the energy dis- 
persion of the fermions and bosons, respectively. For a 
strong optical lattice only nearest neighbor hopping sur- 
vives and the dispersion relation takes the form 



f (q) = -2Jf [cos (qxa) + cos (%a)] 



(4) 



with Jp the hopping energy. The Fermi surface at half- 
filling rip = 1/2 is shown in Fig. [21 and exhibits perfect 
nesting for kow = (7r/a,7r/a) and van Hove singularities 
at k = (0, ±7r/a), (±7r/a, 0). The bosonic energies are 
eB(q) — 2Jb [2 — cos (qxa) — cos (%a)] with €b{0) = 0. 

Integrating out the fermions provides an effective in- 
teraction for the bosons which depends on the temper- 
ature T of the fermionic atom gas. Within linear re- 
sponse theory, the boson density operator nB(q) drives 
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FIG. 2: Left: first Brillouin zone K and Fermi surface of 
2D fermions in an optical lattice. The solid lines denote the 
Fermi surface at half- filling. Right: density of states with 
logarithmic van Hove singularities A'^(e) ~ A^'o In |16Jf /e|. 



the fermionic density (np(q)) = l/pBx(7'7 q)"-B(q) with 
x(T, q) the fermionic response function. A perturbed 
fermionic density in turn acts as a drive for the bosons, 
leading to an effective boson-boson interaction 



{k,k',q,q'} 



[UB + U^BX{T,Cl-C^)]b+b^,b+b^,. 



The fermionic response is given by the Lindhard function 
dk/[ep(k)]-/[ep(k + q)] 



x(r,q) 



^ Vo eF(k) - ep(k + q) 



irj 



(5) 



with V{) = (27r/a)^ the volume of the first Brillouin zone. 
The temperature T enters via the Fermi distribution 
function f{e) = 1/[1 + exp(e/T)] (/ip = at half filling); 
in our weak coupling analysis we are interested in temper- 
atures well below the superfluid transition temperature 
Tkt of the bosons. Using the fermionic dispersion rela- 
tion the Lindhard function exhibits two logarithmic 
singularities. These singularities give rise to instabilities 
in the system towards two new ground states: the sin- 
gularity at q = induces an instability towards a phase 
separated state, while the singularity at knw induces an 
instability towards density wave formation and provides 
a supersolid phase. In the following, we discuss these two 
instabilities in detail. 

For a fermionic system with a regular density of states, 
the Lindhard function at q = reduces to ~^ 
0,0) = -iV(0) at low temperatures, with iV(0) the 
fermionic density of states. However, fermions on a 
square lattice within a tight-binding scheme exhibit a 
logarithmic van Hove singularity in the density of states, 
N{e) = NoK[^/l - eVl6J2] - iVo hi liejp/e] with No = 
l/(27r^Jp) and K[k] the complete elliptic integral of the 
first kind T^, see Fig. |5] The response at half- filling 
rip = 1/2 then behaves as 



X(T -> 0, 0) = / deNie)dJie) ^ -No In 



16ci Jp 
T 



(6) 



with ci = 2exp(C)/7r sa 1.13. 
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The coupling between the bosons and the fermions in- 
duces an attraction between the bosons, and the effec- 
tive long distance scattering parameter takes the form 
U^ff = C/b + C^FB x{T,0)- The thermodynamic stabihty 
of a superfluid condensate at low temperatures requires 
a positive effective interaction U^sf > and the condi- 
tion J7eft(T'ps) = defines the critical temperature Tps 
for phase separation. Using Eqs. we find for the crit- 
ical temperature 



Tps = IGciJpexp [-1/Afb] 



(7) 



with ApB — Up^Nq/Ub ^ 1 the ratio between the in- 
duced attraction and the intrinsic repulsion between the 
bosons. Below the critical temperature Tpg, the effec- 
tive interaction U^tt turns negative, providing a negative 
compressibility and rendering the Bose system unstable. 
The new ground state with fixed averaged densities Ub 
and Up exhibits phase separation with areas of increased 
and decreased local densities coexisting, cf. Fig. 1. 

Note, that this transition towards phase separation ex- 
hibits two major differences as compared to the phase 
separation discussed in Refs. First, our phase sep- 

aration appears as an instability, i.e., for arbitrary small 
coupling U-pB between the bosons and fermions. Second, 
the increase/decrease in the bosonic density drives the 
fermionic density away from half-filling, providing a reg- 
ular x(2^j 0) which stabilizes the system. 

This phase separation is in competition with a second 
instability in the system triggered by the singularity in 
the Lindhard function at kn^v . Using Q and the symme- 
try eF(q+kD\iv) = — CpCq), the Lindhard function becomes 



x(T,kow)=/AiV(e) 



^tanh(e/2T) iVo 
~e 2" 



In 



16ci Jp 



T 



The combination of van Hove singularities and perfect 
nesting produces the [InT]^ singular behavior known 
to produce a Tc-enhancement in superconductivity |2C|. 
Within Bogoliubov theory, the bosonic quasi-particle 
spectrum becomes 



i?B(q) = Vel(q) + 2n3eB(q) [C/b + U^b x{T, q)]. (8) 

The induced attraction between the bosons reduces 
the energy of quasi-particles at k^w which vanishes 
(i?B(kDw) = 0) at the critical temperature 



(quasi-)long-range order with a finite superfluid stiffness 
coexists with a density wave providing diagonal long- 
range order, thus establishing a supersolid phase. Note, 
that decreasing the hopping tp drives a superfluid to 
Mott-insulator transition for commensurate densities Q 
below Ib < tsF-Mi ~ 1/3, providing an additional com- 
peting phase at strong coupling Ib < 1- 

Next, we study the supersolid phase within a mean 
field description. We introduce the mean fields (6o) = 
^/nQN exp(i(^o) and (&kDw) = {^/'^Upb)\/ N/no exp(zc/j) 
and neglect thermal excitations of bosonic quasi-particles 
at T <C Tkt, implying the constraint Ub = tiq + 
A"^ / {^uqU'^b) ■ The bosonic density takes the form (to 
be evaluated at lattice sites) 



nB{x,y) = np + 



A cos 6* r 



C/f 



TTX Try 

cos COS 

a a 



(10) 



with 6 = ipQ — ip; this bosonic density wave appears as 
a result of the interference between the two condensates 
(bo) and (6kDw)- Neglecting terms independent on A, the 
Hamiltonian ^ per unit cell reduces to 



H _ A" 
N^^-^^'^^B 



UbA^ cos^ 
2f/F\ 



^+o(A')- (11) 



The first and second terms describe the increase in the 
kinetic and interaction energies of the bosons, while -ffp 
accounts for the nesting of fermions with q e A' and 
q' = q — kpjw + Km (the reciprocal lattice vector 
ensures the constraint q' G K) 



Hp 



eF(q) Acos0 
A cos 6* eF(q') 



(12) 



Diagonalizing, we obtain the fermionic quasi-particle ex- 
citation spectrum eF(k, A) — ±[ep(k) + cos^ ^A^]^/^. 
Minimizing the thermodynamic potential ^{T, A, 9) pro- 
vides the constraint 9 = stt, with s an integer, and the 
self-consistency relation {Oa^ = 0) 

• ,2 + y.±/ii5!ifi&^, ,13, 

Afb No Jk eF(k, A) 

Setting A = 0, we reproduce the critical temperature 
®. Using the density of states iVA(e) = iV(\/e^ - A^) 



A^, the gap at T = becomes 



16ci Jp exp 



V(2 + tB)/AF 



(9) 



A(0) = 32JFexp -^(2 + iB)/A 



(14) 



with ^B = SJb/ubUb the ratio between the kinetic and 
the interaction energy of the bosons (weak coupling re- 
quires ^B ^ Afb). Below this critical temperature, 
the boson mode &kDw becomes macroscopically occu- 
pied and its interference with the condensate produces 
a bosonic density wave, see below. In this new phase, 
a (quasi-)condensate characterized by an off-diagonal 



and we obtain the standard BCS relation 2A(0)/Tow — 
2TT/e'~' « 3.58. The mean field (bo) = \/noN exp[i(po] 
breaks the continuous C/(l) symmetry of the system and 
describes the off-diagonal quasi-long-range order. The 
excitation spectrum exhibits a linear dispersion around 
q = and the quasi-long-range order is sufficient to pro- 
vide a finite superfluid stiffness 0- On the other hand. 



4 



the mean field (&kDw) characterizes a commensurate den- 
sity wave. Its phase is locked to the condensate phase 
via the constraint 9 — sir and the excitation spectrum 
around q = k^w is gapped. The transition breaks the 
discrete translation symmetry and establishes diagonal 
long-range order; breaking a discrete symmetry, diagonal 
long-range order can exist even at finite temperatures. 

The competition between the two instabilities at q = 
and knw provides the phase diagram as shown in Fig. ^ 
For 

^Dw > ^ps the system undergoes a transition into 
a supersolid phase at T^w; the gap in the fermionic ex- 
citation spectrum then removes the instability towards 
phase separation luring at lower temperatures. In turn, 
for Tps > the instability towards phase separation 
wins over the density wave formation and drives the 
fermionic density away from half-filling; the nesting at 
knw is quenched and the instability towards density wave 
formation disappears. The projection of the critical line 
Tps = Tow onto the ApB-l/^B-plane satisfies the relation 
1/t-B — Afb/(1 — 2Afb); with decreasing coupling Afb we 
enter the supersolid phase, while increasing the hopping 
^B drives the system towards phase separation. 




in- and out-of-plane lattice constants a and a^. The pa- 
rameter 7 = 2azl\ then denotes the increase in the unit 
cell volume and allows to tune the interaction strengths 
C/b and J7fb independent on Jf b (alternatively, Feshbach 
resonances allow to tune ftFB 

). Fixing = 20, Hf = 1/2, 
and ?1b — 3/2, we obtain for 7 = 3 and Vp = 4.5 the cou- 
pling parameters Afb ~ 0.39, « 0.55 (Tow ~ 48 nK); 
we enter a regime at the border of validity of our weak 
couphng analysis. Using the above estimates, the Vf-7 
phase diagram is shown in Fig. |3 we find that chang- 
ing the strength of the optical lattice V-p allows to drive 
the transition from the supersolid to a phase separated 
state. The supersolid state is easily detected via the usual 
coherence peak of a bosonic condensate in an optical lat- 
tice and the additional appearance of coherence peaks at 
kow; using the above parameters, the weight of these ad- 
ditional peaks involve 15% of the total particle number. 

In conclusion, we have identified a new supersolid 
phase in a 2D Fermi-Bose gas mixture subject to an op- 
tical lattice; the bosons then play the role of the phonons 
in a condensed matter system. The perfect Fermi-surface 
nesting leads to the appearance of a fermionic density 
wave and the condensation of the bosons at kow- 

The 

interference of this kow-condensate with the usual q = 0- 
condensate establishes the bosonic density wave charac- 
teristic of the supersolid phase. 

We thank T. M. Rice, T. Esslinger, M. Kohl, and M. 
Troyer for stimulating discussions. 



FIG. 3: Left: Vf-7 phase diagram at low temperatures. In- 
creasing the strength of the optical lattice in an experiment 
allows to drive the transition from a supersolid to a phase 
separated state. Right: Transition temperatures for 7 = 3 
{El = 347 nK). 

Finally, we estimate the relevant experimental pa- 
rameters for an atomic mixture of fermionic '^''K and 
bosonic ^^Rb with scattering lengths Cb = 5.77 nm and 
Afb ~ 15 nm 0. The 2D setup is realized through appli- 
cation of an anisotropic 3D optical lattice (A = 830 nm 
and Vp/V^ « 3/7), with > 14 and » K quench- 
ing the inter-plane hopping (we express Vf.b and V-^-^ via 
the recoil energies El ^ = 27r2?iVA^mF,B)- The hopping 
amplitudes Jf,b derive from the ID Mathieu equation, 

Jf.b = {A/^/^)E;,,V^'^\^Y^{-2./v^^), (15) 
while the interactions [/fb and U-a are given as ml 



UjB_ _ , /- 1 + mp/m, 

El " '^''(1 + 7^7^)3/2 A7 



(K^)'/V;/^ (16) 



and U^/El ^ 4\/2^(aB/A7) {V^f'^ V^'^ . Using a finite 
angle between the laser beams producing the standing 
light waves, we allow to change the relative size of the 
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